Information Processing by a Noisy Binary Channel
نویسنده
چکیده
We study the information processing properties of a binary channel receiving data from a gaussian source. A systematic comparison with linear processing is done. A remarkable property of the binary sytem is that, as the ratio between the number of output and input units increases, binary processing becomes equivalent to linear processing with a quantization output noise that depends on. In this regime , that holds up to O(?4) , information processing occurs as if populations of binary units cooperate to represent one-bit output unit. Unsupervised learning of a noisy environment by optimization of the parameters of the binary channel is also considered.
منابع مشابه
Comparison of Two Contextual Post - Processing Algorithms for Text Recog
The binary n-gra~ and Viterbi algorithms are alternative approaches to con-te.xtual post-processing for text produced by a noisy channel such as an optical character recognizer. The paper describes the underlying theory of each approach in unified terminology, presents a storage efficient data structure for the binary n-gram algorithm and a recursive formulation for the viterbi algorithm. Relat...
متن کامل'kradeoff Between Source and Channel Coding
A problem in the transmission of analog information across a noisy discrete channel is the choice of channel code rate that optimally allocates the available transmission rate between lossy source coding and block channel coding. We establish tight bounds on the channel code rate that minimizes the average distortion of a vector quantizer cascaded with a channel coder and a binary symmetric cha...
متن کاملTradeoff between source and channel coding
A fundamental problem in the transmission of analog information across a noisy discrete channel is the choice of channel code rate that optimally allocates the available transmission rate between lossy source coding and block channel coding. We establish tight bounds on the channel code rate that minimizes the average distortion of a vector quantizer cascaded with a channel coder and a binary-s...
متن کاملRSA Meets DPA: Recovering RSA Secret Keys from Noisy Analog Data
We discuss how to recover RSA secret keys from noisy analog data obtained through physical attacks such as cold boot and side channel attacks. Many studies have focused on recovering correct secret keys from noisy binary data. Obtaining noisy binary keys typically involves first observing the analog data and then obtaining the binary data through quantization process that discards much informat...
متن کاملStegosystems Based on Noisy Channels
Resumen We propose a significant deviation from the standard steganography problem formulation. Here, an attacker is able to receive a stegosignal only over noisy channels. There may be also situations in which the presence of a noisy channel is simulated by a designer of the stegosystem to hide secret messages. Two models of noisy channels are considered: binary symmetric channel (BSC) and add...
متن کامل